A fast Newton’s iteration for M/G/1-type and GI/M/1-type Markov chains

نویسندگان

  • Juan F. Pérez
  • Miklós Telek
  • Benny Van Houdt
چکیده

In this paper we revisit Newton’s iteration as a method to find the G or R matrix in M/G/1type and GI/M/1-type Markov chains. We start by reconsidering the method proposed in [14] which required O(m +Nm) time per iteration, and show that it can be reduced to O(Nm), where m is the block size and N the number of blocks. Moreover, we show how this method is able to further reduce this time complexity to O(Nr + Nmr + mr) when A0 has rank r < m. In addition, we consider the case where [A1A2 . . . AN ] is of rank r < m and propose a new Newton’s iteration method which is proven to converge quadratically and that has a time complexity of O(Nm +Nmr +mr) per iteration. The computational gains in all the cases are illustrated through numerical examples.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the Dual Relationship between Markov Chains of Gi/m/1 and M/g/1 Type

In 1990 Ramaswami proved that, given a Markov renewal process of M/G/1– type, one can construct a Markov renewal process of GI/M/1–type such that the matrix transforms G(z, s) for the M/G/1–type process and R(z, s) for the GI/M/1–type process satisfy a duality relationship. In his 1996 PhD thesis, Bright used time reversal arguments to show that it is possible to define a different dual for pos...

متن کامل

Determination of Explicit Solution for a General Class of Markov Processes

In this paper, we study both the GI=M=1 type and the M=G=1 type Markov chains with the special structure A 0 = !. We obtain explicit formulas for matrices R and G, which generalized earlier results on Markov chains of QBD type. In the case of GI=M=1 type, we show how to nd the maximal eigenvalue of R, and then that the computation of R is equivalent to that of x 2. In the case of M=G=1 type, we...

متن کامل

An Invariant Subspace Approach in M/g/1 and G/m/1 Type Markov Chains

Let A k ; k 0, be a sequence of mm nonnegative matrices and let A(z) = P 1 k=0 A k z k be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation G = P 1 k=0 A k G k has been shown to play a key role in the analysis of Markov chains of M/G/1 type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix eq...

متن کامل

A Fixed Point Approach to the Classification of Markov Chains with a Tree Structure

In this paper, we study the classification problem of discrete time and continuous time Markov processes with a tree structure. We first show some useful properties associated with the fixed points of a nondecreasing mapping. Mainly we find the conditions for a fixed point to be the minimal fixed point by using fixed point theory and degree theory. We then use these results to identify conditio...

متن کامل

An Invariant Subspace Approachin M / G / 1 and G / M / 1 Type Markov

Let A k ; k 0, be a sequence of m m nonnegative matrices and let A(z) = P 1 k=0 A k z k be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation G = P 1 k=0 A k G k has been shown to play a key role in the analysis of Markov chains of M/G/1 type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix e...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011